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The Hamiltonian Mean Field (HMF) model has a low-energy phase where N 
Q , particles are trapped inside a cluster. Here, we investigate some properties of the 

' trapping/untrapping mechanism of a single particle into/outside the cluster. Since 

■ the single particle dynamics of the HMF model resembles the one of a simple pendu- 

lum, each particle can be identified as a high-energy particle (HEP) or a low-energy 
particle (LEP), depending on whether its energy is above or below the separatrix 
energy. We then define the trapping ratio as the ratio of the number of LEP to the 
total number of particles and the "fully-clustered" and "excited" dynamical states 
as having either no HEP or at least one HEP. We analytically compute the phase- 
space average of the trapping ratio by using the Boltzmann-Gibbs stable stationary 
solution of the Vlasov equation associated with the N ^ oo limit of the HMF model. 
^ I The same quantity, obtained numerically as a time average, is shown to be in very 

^ ' good agreement with the analytical calculation. Another important feature of the 

dynamical behavior of the system is that the dynamical state changes transitionally: 
the "fully-clustered" and "excited" states appear in turn. We find that the distri- 
bution of the lifetime of the "fully-clustered" state obeys a power law. This means 
that clusters die hard, and that the excitation of a particle from the cluster is not 
a Poisson process and might be controlled by some type of collective motion with 
long memory. Such behavior should not be specific of the HMF model and appear 



o 

\o 
o 
\o 
o 



* koyama@gravity.phys.waseda.ac.jp 
t tkomshi@r. phys.nagoya-u.ac.jp 
stefano.rufTo@unifi.it 



2 



also in systems where itinerancy among different "quasi-stationary" states lias been 
observed. It is also possible that it could mimick the behavior of transient motion 
in molecular clusters or some observed deterministic features of chemical reactions. 

PACS numbers: 



I. INTRODUCTION 

In systems with long-range interactions it is quite common that particle dynamics 
leads to the formation of clusters. This happens for instance in self-gravitating systems P|, 
where massive particles interacting with Newtonian potential, initially put in a homoge- 
neous state, can create patterns made of many clusters. This phenomenon can be observed 
in simplified models, like the one-dimensional self-gravitating systems (sheet models) 
For this model an itinerant behavior between "quasi-equilibria" and "transient" states 
has been observed in the long-time evolution j^. In the "quasi-equilibrium" states particles 
are clustered, as at equilibrium |6j, but with different energy distributions. In the "tran- 
sient" states one particle emitted from the cluster bears the highest energy throughout the 
lifetime of the state. The authors of Ref. jbl also claimed that averaging over a sufficiently 
long time, which includes many quasi-equilibrium and transient states, should give approx- 
imately thermal equilibrium. Motion over several quasi-stationary states is observed also 
in other Hamiltonian systems, like globally coupled symplectic map systems 7], or even 
in realistic systems of anisotropically interacting molecules j8i]. This shows that thermal 
equilibrium is not the only possible asymptotic behavior of Hamiltonian dynamics. For 
such cases approaches other than standard statistical mechanics would be needed. Com- 
ing back to one- dimensional self-gravitating systems, the generation of high-energy particles 
plays an important role in dynamical evolution. However, a difficulty of the model is that 
the definition of high-energy particle is ambiguous, which is an obstacle to precisely define 
"quasi-stationary" and "transient" states. 

A time continuous Hamiltonian model for which particle clustering has been studied 
both from the statistical and the dynamical point of view is the Hamiltonian Mean Field 
Model (HMF) which describes the motion of fully coupled particles on a circle with 

attractive/repulsive cosine potential. Recent reviews discussing this model can be found in 
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Refs. nil, Il2| . This model has a second order phase transition and, in the ordered low energy 
phase, particles are clustered. However, when the number of particles is finite, some particles 
can leave the cluster and acquire a high energy. Hence, the "fully-clustered" state has a finite 
lifetime and an "excited" state appears where at least one particle does not belong to the 
cluster Q, Therefore, below the critical energy, we can observe a similar itinerant 

behavior as for one-dimensional self-gravitating systems, between a "fully-clustered" state 
and an "excited" state. 

In this paper we investigate and characterize the intermittent transitions between these 
states during a long-time evolution for the HMF model. The main advantage of studying 
this phenomenon for the HMF model is that the ambiguity to define the dynamical states 
can be resolved. In fact, the equations of motion of each HMF particle can be represented as 
those of a perturbed pendulum. An ordinary simple pendulum shows two types of motion: 
libration and rotation. It shows libration when the phase-point is inside the separatrix, and 
rotation when it is outside the separatrix. We then define High-Energy Particles (HEP) of 
the HMF model as those particles which are outside the separatrix, and Low-Energy Particles 
(LEP) as those which are inside the separatrix. This allows us to define a "trapping ratio" 
which takes the value 1 for the "fully-clustered" state and is strictly smaller than 1 in the 
"excited" state. Contrary to an ordinary simple pendulum, the value of the separatrix energy 
is not constant in time and hence the trapping ratio can fiuctuate in time. Here, we show 
that the numerically computed time-averaged trapping ratio agrees with that obtained by 
a statistical average performed for the Boltzmann-Gibbs stable stationary solution of the 

nn 

Vlasov equation associated to the HMF model 110| • However, we find numerically that 
the probability distribution of the lifetime of the "fully-clustered" state is not exponential 
but follows instead a power law. Therefore, although an average trapping ratio exist, there 
appear to be no typical trapping ratio in the probabilistic sense. 

This paper is organized as follows. In Sec. |Hj we review the HMF model and define 
the dynamical states of the system. In Sec. II I II we estimate analytically the trapping ratio, 
using a Vlasov equation approach and compare it with the value obtained from numerical 
simulations. In Sec. IIVI we numerically compute the probability distribution of the lifetime 
of the "fully-clustered" state in order to show that it obeys a power law. The final section 
is devoted to summary and discussion. 
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II. MODEL AND DEFINITION OF DYNAMICAL STATES 



In this section we introduce the HMF model and define the dynamical states of the 



system. The Hamiltonian of the HMF model 



[3 is 



N 2 ^ 

H = K + v = J2^ + ^J2^i-cosie,-e,)]. (1) 

i=l iii=l 

The model describes a system of particles moving on a circle, each characterized by an 
angle 6i and possessing momentum pi. The interaction force between each pair of particles 
is attractive or repulsive, for e > or e < 0, respectively. In the following we will consider 
only the attractive case, with e = 1. In this case, the model displays a second order 
phase transition at the energy density U = H/N = 3/4 from a "clustered" phase at low 
energy (where particles are clumped) to a "gas" phase at high energy (where particles are 
homogeneously distributed on the circle). The HMF model is a globally coupled pendulum 
system, and the equations of motion can be expressed as those of a perturbed pendulum, 

^; = -Msin(ei-0), (2) 

where M (the order parameter of the phase transition) and the phase are defined as 



/ N N \ 

- Jocose,, 5^ sin . (3) 
\j=i j=i / 



The single particle energy is 

2 

ei = |- + [l-Mcos(^,-0)]. (4) 
Then, the separatrix energy Egep is 

E,ep = 1 + M, (5) 



and the resonance width is 2vM. 

An ordinary simple pendulum shows two types of motion: libration and rotation. It shows 
libration when the phase point is inside the separatrix, and rotation when it is outside the 
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separatrix. We define High-Energy Particles (HEP) of tlie HMF model as those that lie 
outside the separatrix, i.e. their energy is larger than the separatrix energy, > E^^p ■ 
Low-Energy Particles (LEP) lie instead inside the separatrix, and have energy Cj < Egep- 
Contrary to the simple pendulum, each particle of HMF model can go from inside to outside 
the separatrix and vice versa, because M and are time dependent. 
Next, we define the trapping ratio R as 

R = (6) 

where N^ep is the number of LEP. Finally, we define the dynamical states of the system. 
We say that the system is "fully-clustered" if all the particles are LEP. Otherwise, if at least 
one particle, among the N , is HEP, we say the system is "excited" . The value of i? is 1 if the 
system is in the "fully-clustered" state, it is less than one if the system is in the "excited" 
state. 

Let us discuss an example where these states appear. The system has N = 8 particles and 
total energy density U = 0.4 (below the phase transition energy). In the initial condition 
particles are uniformly distributed in a square rectangle [—6*0,^^0] x [~Po,Po] of the single- 
particle phase-space, with 6q and po conveniently chosen in order to get the energy U. This is 
the so-called "water-bag" initial distribution. As shown in Fig. ^the system shows both the 
"fully-clustered" (panel (a)) and the "excited" state (panel (b)) at different time instances, 
and can switch from one to the other. In the "fully-clustered" state positions of all the 
particles fluctuate around a given angle. In the "excited" state one HEP has escaped from 
the cluster and rotates on the circle (all the others remain clustered). The momentum 
extracted by the HEP is compensated by an opposite momentum acquired by the cluster. 
This is a typical situation that appears in the low-energy phase of the model. It may be 
that more than one particle escapes from the cluster, expecially if the energy is increased. 

From this example it is clear that the trapping ratio i? is a time fluctuating quantity. In 
the next section, we will show that the Boltzmann-Gibbs equilibrium solution of the Vlasov 
equation associated to the HMF model allows us to compute analytically the time average 
of i? as a function of the energy density U. The result will be successfully compared with 
numerical simulations performed at finite N. 

Another quantity of interest is the time duration of the "fully-clustered" state. We define 
the lifetime r of the "fully-clustered" state as the time interval from the absorption of a 
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HEP to form the full cluster to the excitation of a particle from the cluster again. We will 
study numerically the properties of the probability distribution of r. 



III. CALCULATION OF THE AVERAGE TRAPPING RATIO 

In this section we introduce the Vlasov equation corresponding to the N oo limit 
of Hamiltonian (0) j^, and we derive the stationary stable solution corresponding to 
Boltzmann-Gibbs equilibrium. We then show how the knowledge of this solution allows 
us to derive the average trapping ratio. 

The Vlasov equation for the HMF model is 

di di_ dVdl _ 

dt^^do dedp~ ' 

-| /*27r poo 

Vie) = - / / [1 - cos(^ - e')] fie',p')de'dp', (8) 

^ Jo J-oo 

where f{0,p, t) is a single particle distribution function and V{9) is the self-consistent poten- 
tial. According to Ref. [lJ|, this Vlasov equation has the following Boltzmann-Gibbs stable 
stationary solution 

fBGiO,p) = e{9)p{p) = A/I^exp (-^] -— ^— — exp(/3(M)cos^), (9) 



271 V 27 27r/o(/9(M)) 
where Iq is the zero-order modified Bessel function and (3 is the inverse temperature (3 = 1/T 
{ks = 1). Temperature is twice the kinetic energy T = 2K. (M) is the solution of the self- 
consistency equation 

him)) 



(M) 



(10) 



W{M)) 

We easily find that Eq. ()10j) has a non-zero solution only if the temperature is sufficiently 
low, i.e., T < Tc = 1/2. = 1/2 (corresponding to U = 3/4) is the temperature of the 
second order phase transition. 
The averaged potential energy is 

{V) = j%{e)Q{e)de = \{i~{M)\ (ii) 

and the total energy density is 

U = \ + \{l-{Mf). (12) 



In Ref. the energy dependence of the time average trapping ratio R{U) has been 
numerically calculated. The authors claimed that this quantity remains close to unity up 
to f/ = f/fe ~ 0.3 and that it quickly decreases to zero as soon as f/ ~ Uc- Here, we analyti- 
cally compute the statistically averaged trapping ratio {R){U), using the Boltzmann-Gibbs 
distribution function 0. The main idea of how to perform this calculation is that of asso- 
ciating the average trapping ratio to the integral of the single particle distribution function 
performed inside the phase-space region Q bounded by the upper and lower separatrices of 
the pendulum motion 

{R){u)= [ fBG{e,p)dpde. (13) 

Jn 

Using formula 0, we obtain 

{R)iU) = 2ni,(l{M)) C (v/(M)/3(l + cos^^)) exp{(3{M)cose)de, (14) 

where Erf is the error function. The integral in this equation has been performed numerically 
to obtain the {R){U) function plotted in Fig.|21 Numerical values of {R){U) are also reported 



in Table 1. The values we obtain for {R){U] 
R{U) , first computed numerically in Ref. 



are consistent with the time averaged quantity 



1^ . However, we have decided to repeat these 
numerical calculations for = 100 at various energy densities: the corresponding results 
are plotted in Fig. |21 The agreement between {R){U) and R{U) is extremely good. 

In order to characterize the finite fluctuations of the "fully-clustered" state, which 
may create HEP even below the critical temperature, we will analyze in the next section the 
probability distribution of the lifetime of the clustered state. 



IV. POWER-LAW DISTRIBUTION OF THE LIFETIME OF THE 
FULLY-CLUSTERED STATE 

In this section, we will further characterize the properties of the fully-clustered state, 
de^cnbing in n,o.e detail the t.apping-unt.appmg p™ce.= for a .mall numbe. of particles (a 

study that has already been partially done in Ref. |10l|). 

Below the critical energy density, U < Uc, HEP are repeatedly excited from and absorbed 
into the cluster in an intermittent fashion. The fully-clustered and excited states appear in 
turn, and the static picture predicted by the Vlasov equation, where particles that are within 
the separatrices remain there forever, is never observed. Nevertheless, quite surprisingly, this 
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intermittent state produces, as we have discussed in the previous section, a time average 
trapping ratio which is in good agreement with Vlasov equation predictions. 

We want therefore to study the statistical properties of the hfetime of the cluster, as 
defined above for a finite number of particles, beginning with small systems of = 8 par- 
ticles. If the trapping-untrapping transition process were a Poisson process, the probability 
distribution of the lifetime of the fully-clustered state would be exponential. The results of 
our numerical simulations are shown in Fig. El The distribution is definitely not exponential 
but, rather, it obeys a power law, with an exponent that appears to be slightly dependent 
on U and to be close to —1. 

At fixed U, as the number of particle increases, the distribution is cut-off at large times. 
This effect is less evident in Fig. OK than in Fig. Ob- We think that this is due to the difference 
in energy between the two cases: at the smaller energy of Fig. one would probably need 
a larger value of to make the cut-off visible. Indeed, the presence of such a cut-off time is 
compatible with the fact that the average trapping ratio is finite, as shown in the previous 
section. 

In order to get an estimate of the number of particles needed to produce the cut-off, we 
propose the following heuristic argument. The single-particle untrapping probability per 
unit time can be assumed to be proportional to 1 — {R){U). In order to destroy the fully- 
clustered state, it's enough that one particle untrap, hence the probability per unit time that 
the fully clustered state is destroyed is proportional to N{1 — {R){U)). When this probability 
is of order 1, the fully-clustered state is destroyed. A preliminary numerical study of the 
behavior of (R) for small U gives the non perturbative behavior (R) = 1 — exp(— 2/f/). 
Therefore, the number of particle needed to create the cut-off diverges as exp(2/t/) in the 
limit U —>■ 0, a growth that is faster than any power. The power-law behavior of the lifetime 
distribution could in principle extend to infinite time in this limit. This argument could be 
tested numerically and will be the subject of future investigations. 

V. SUMMARY 

In this paper, we have investigated the dynamical behavior of the Hamiltonian Mean Field 
(HMF) model, focusing in particular on the mechanisms of particle trapping and untrapping 
from the cluster that is formed in the low-energy phase. Using the notion of separatrix for 
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the related pendulum dynamics, we have been able to define precisely the dynamical state 
of "full-clustering" , and the "excitation" of a single particle. 

We have defined the trapping ratio as the ratio of the number of particles that are trapped 
in the cluster (with energy smaller than the separatrix energy) to the total number of 
particles. Using the Boltzmann-Gibbs stable stationary solution of the Vlasov equation, 
and performing a phase space integral within the separatrix region, we have been able to 
compute analytically the phase-space average of the trapping ratio. This quantity has been 
also obtained from numerical simulations of the iV-body dynamics of the HMF model and it 
has been shown to be in perfect agreement with the Vlasov equation analytical calculation. 

Below the critical energy, when the number of particles is finite, the dynamical state 
of the system changes transitionally: the "fully-clustered" and "excited" states appear in 
turn. That is, high-energy particles (HEP) are excited from and absorbed into the cluster 
intermittently. We have numerically computed the probability distribution of the lifetime of 
the "fully-clustered" state, finding that it obeys a power law. This shows that the excitation 
of a particle below the critical energy of the HMF model is not a Poisson process. 

The discovery of the power law in this system is quite interesting and important. Its 
existence implies that, at the moment of ejection of an HEP, the system still "remembers" 
when the previous HEP had been swallowed into the cluster. One might think that the 
system would tend to behave "thermally" as the number of particles is increased, producing 
an exponential cut-off of the lifetime probability distribution. Although a cut-off at large 
times is present in the numerical simulations, the power law is observed over many decades 
and its extension increases quite rapidly with the number of particles. A heuristic calculation 
based on the Vlasov equation gives a non-perturbative fast increase of the number of particles 
necessary to observe the cut-off. 

It will be interesting to investigate the physical origin of the strong temporal correlations 
which give rise to the power-law behavior of the lifetime of the fully-clustered state: a 
possible collective particle motion is a candidate. 

Moreover, the power law behavior of the lifetime of clustered states should not be specific 
of the HMF model. It could appear also in systems showing chaotic itinerancy among "quasi- 
stationary" states, like those mentioned in the Introduction jj] and in models of interacting 
molecules j^. 

Finally, if we look at the HMF model as representing an "abstract molecule", then the 
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excitation and decay of HEP could be considered as a chemical reaction. Then, the power-law 
type behavior of the lifetime discovered in this paper implies the possibility of non-standard 
behavior of chemical reactions: the reaction rate might be dynamically governed by the 
coherent motion of the reactants 11511 . 
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TABLE I: Statistical equilibrium values of order parameter, temperature and average trapping 
ratio at different energy densities 
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FIG. 1: a) Time evolution of the positions of the particles on the circle for the HMF model in 
a "fully-clustered" state; b) same time evolution for an "excited" state. Number of particles is 
N = 8, system energy density is U = 0.4 and the initial condition is a "water-bag". The two states 
coexist in a given orbit of the system and appear at different times. 
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FIG. 2: Average trapping ratio vs. energy density. The full line is the result of the analytical 
calculation of the statistical average {R){U). The points correspond to the numerical calculation 
of the time average R{U). 
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FIG. 3: The distribution of the hfetime of the fully-clustered state with total energy U = 0.3 (panel 
(a)) and U = 0.4 (panel (b)). Numbers of particles are 8, 16, 32, 64 and 128. The power index is 
well-fitted by —0.8 (panel (a)) and —0.9 (panel (b)). 



